Max-Margin Contrastive Learning
نویسندگان
چکیده
Standard contrastive learning approaches usually require a large number of negatives for effective unsupervised and often exhibit slow convergence. We suspect this behavior is due to the suboptimal selection used offering contrast positives. counter difficulty by taking inspiration from support vector machines (SVMs) present max-margin (MMCL). Our approach selects as sparse vectors obtained via quadratic optimization problem, contrastiveness enforced maximizing decision margin. As SVM can be computationally demanding, especially in an end-to-end setting, we simplifications that alleviate computational burden. validate our on standard vision benchmark datasets, demonstrating better performance representation over state-of-the-art, while having empirical convergence properties.
منابع مشابه
Efficient Max-Margin Metric Learning
Efficient learning of an appropriate distance metric is an increasingly important problem in machine learning. However, current methods are limited by scalability issues or are unsuited to use with general similarity/dissimilarity constraints. In this paper, we propose an efficient metric learning method based on the max-margin framework with pairwise constraints that has a strong generalizatio...
متن کاملLearning Max-Margin Tree Predictors
Structured prediction is a powerful framework for coping with joint prediction of interacting outputs. A central difficulty in using this framework is that often the correct label dependence structure is unknown. At the same time, we would like to avoid an overly complex structure that will lead to intractable prediction. In this work we address the challenge of learning tree structured predict...
متن کاملMax-Margin Multiple-Instance Dictionary Learning
Dictionary learning has became an increasingly important task in machine learning, as it is fundamental to the representation problem. A number of emerging techniques specifically include a codebook learning step, in which a critical knowledge abstraction process is carried out. Existing approaches in dictionary (codebook) learning are either generative (unsupervised e.g. k-means) or discrimina...
متن کاملContrastive Max-Sum Opinion Summarization
People can reach all kinds of information online including reviews and comments on products, movies, holiday destinations and so on. However, one usually need to go through the reviews to have an objective opinion the positive and the negative aspects of the item reviewed. We aim to provide a method that will extract positive and negative opinions on a specific aspect and compare them in an att...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i8.20796